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Seven: years* experience in the utilization of 
instructional teclmolbgy by the University of Wisconsin £of the 
cpntihuirig^ education of health care personnel is reviewed. During the 
period 1965-1972 doctors and allied support professionals vere given 
access to telephone conferences, a dial access library, films, 
tape/slide programs and^elevision. A report of the iinpact- cf media 
oriented instruction upon profesjdipnals' knowledge and upon patient 
cafe is given, alongf VitJi a description of fiituie efforts to pay 
attention to the identification of educational needs, to the existing 
deficiencies in medical education, and to -the establishment of 
patterns of lifetime learning. (PB) 
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Ahstract. Seven years* exi)erieiiee in utilixation of iustriie- 
tloual technology in eontinniug education programming nt the 
University of \Vi.scoasin i.s reiwrted. Specific hie<Iia ami 
mcth'oflology used im-Indc teleplionc confcrent-cs. dijil access 
Jibran". single concept films.. tni)e/slide programs and slow 
scan television, with attempts at evahiation of eacli described. 
The ^experience indicates that, more attention must be given 



to identification of echicatioual needs, deficiencies in medial 
school tniiuing programs, and eyahiatioii of end results before 
optimum uscof edticational tecinioh)gy in continuing education 
is i)ossibIe. 

Kry worth: Medical education. cf)ntiiniing education^ 
technology, evaluation, needs identification, testing, telclectiirey 
dial access, Aiidio*visuaI, 



In n)(>5 the Faculty of the UnivcrsiU* of Wisconsin 
Center for Health Sciences decided that the Center 
shpiihUassunic a greater responsibility* for tlie contin- 
uing cducation'of health professionals. In determining 
the fonn this committment should take, a numlicr of 
"factors were considered. First, the profcissionals to be 
served are widely scattered gcographicall}*. Secondly, 
there is evidenee to show that adults learn better 
through problem -oriented education. Third, there is 
also evidence that people acquire and retain informa- 
tion iHJtter if it is presented in smaller units with great 
freqiicnoy rather tlian massive doses on occasion. 
Fourth, there is a substantial volume of continuing 
education available to physicians and a lesser amount 
to allied health i)ersonnel; however, these traditional 
e.\ereisa<5 appeared ver}* time consuming for the 
potential lx?nefit derivetl. 

The conclusion was that if the University were to 
make a worthwhile contribution it would require 
innovation. There appeared to l)e promise in making 
current, i)ertinent and authoritative information 
available when, where, and in the form health pro- 
fessionals required it. This led to investigation of the 
potential of educational technology, and specifically 
in e.\i)erimentation with: 

J . Telephone Conferences. 

2. Dial Access Tajxi Reconiing Library. 

3. Single Concept Films. 
4; Tape/Slide Programs. 
5. Slow Scan Television. 

These methods will be discussed along with 
significant problems the implementation of the.se 
programs uncovered; which have led to a redirection 
of research emphasis within the Department of 
Postgraduate Medical Education in recent years. 
Finally, the latter part of this paper will discuss at 
some length the problems inherent in the identification 
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of educational needs, the continuum of education and 
the establishment of patterns of lifetime learning. 

Educational Technology 
Technology has played an important role in the 
development of current programs. This emphasis is 
reflected in the ethicationaLservices providetl during 
the n)7l-l972 academic year (Table I), Of the J7887 
instances where pliysiciaas used an educational service, 
16012 or 04.81% of these involved metlia. For allied 
health personnel the figures are comparable: of the 
13760 instances where .services were u.sed, 12035 of 
these or 94.00% involved inetlia. Admittedly, .some of 
the media .services involved a five-minute tape 
recording while a "live" exercise niay have Iwen a 
three-day conference. However,- in examining data 
which take this imbalance into account, there were 
50255 individual hours of instruction presented, of 
which 22290 or 44.23% involved media.. 

Table 1. 1971-1072 postgniduate educational .services iinivcr- 
.sity of Wisconsin 





Physi- 
cian 
utiliza- 
tion 


Allied 
healt 
utiliza- 
tion 


Total 

Mtiliui- 

tion 


Indi- 
vidual 
hours of 
in.st ruc- 
tion 


Lire teaching 
Conferences 
Credit cotirse.s 
Con.stdtant service 


874 

48 


075 
0 
150 


.1549 
3 
198 


24552 
2880 
594 


Sub-total 


925 


825 


1750 


28020 


Media teaching 

Teleplioneconferenccs 205 
Dial access library o0()8 
Single concepts films 10600 
Tape/slide programs S79 


1265 
<)40 
11000 
24 


15:U) 
0314 
21600 
403 


10875 
031 

4320 
403 


Std)-total 
Total 


1<)9]2 
178:J7 


12»:J;> 

i:j70o 


29847 
31597 


22229 
50255 



erJc 



0 
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Tehphonc Conferences 
When tlio (Iciwrtiiiciit wa.s foriiiod Jsevcii yeai*s ago, 
the fii-st effort was to initiate a piograiri whereby 
leciiires conkl 1x5 |)re^cnte(l via telephone to practi- 
tiOnci*s in the state [7J. The goals were to offer instruc- 
tion of the highest caHhre, on a eontinuing basis, to 
focus on topics of direct application to cliiiical practice, 
at low cost, and without i-eqiiiring the practitioner to 
leave his patient care responsibilities for any prolonged 
period. 

When 10 or nu)i-e practitioners enrolled in one 
coiniuunity, a conference station was established at 
the local hospital or clinic. Station equipnient in- 
cluded a Iouds|)eaker connected* to the uicouiing 
telephone line, a telephone handset for cbnuuunicatioh 
with all other statioiis on the network, and a 35 nun 
slide piojectoi-. Tho ho.spitals were connected by ^a 
network of private telephone lilies leased oh' a full-time 
basis for teachiiig ptirposes. Programs originated from 
the University of Wisconsin campiiSr 

A general forinat was devi.sed, including approxi- 
mately 30 miinitcs of ilhistratcd lecture aiid 30 minutes 
of discussion. The lecture was tapa recorded in advance 
and visuals were duplicated and a set mailed to each 
^lospital prior to the conference for display during the 
recorded lecture, on command of the lecturer. When 
the formal portion of the program was completed, 
participants in the hcxspitals could come on the circuit 
and ask (jucstions; each question and the lecturer's 
response would be heard at all lio.*>pitals. 

There was rcad}^ acceptance of the medium. From 
the original 18 hospitals on the circuit in 1965, it has 
grown to 75 participating hospitals in 1972. Pro- 
graiiuning is presented weekly for phj^sicians and 
monthly for a variety of allied health personnel. 

The concept was not original with Wisconsin. It 
has been pioneered at Albany Medical College, Albany, 
New York [14], and similar programs had been con- 
ducted in Australia [9] and Britain [1]. 

It« newness to Wisconsin, however, did impose an 
obligation for evaluation, and a number of limited 
studies were carried out. Most significant of these, 
at least to the originators, involved measurement of 
retention and acquisition of knowledge in a course on 
electrocardiograph}*. The same course, involving 16 
hours of instruction, was presenterl to a. group of 52 
ph3-sicians over the telephone circuit, and concurrently 
to a class of 42 third-year medical students, in a 
classroom setting. Pre-, post- and late post-tests were 
given; the results are presented in Fig. 1. Both groups 
demonstrated an acquisition of knowledge, with the 
medical students achieving slightly higher immediate 
post-test scores. Both showed retention of knowledge 
after a si.x-month interval; the medical students had 
an anticipated decay but the practitioners demon- 
strated additional improvement. While it is only 
conjecture, one possible reason is that those in practice 
put their new knowledge to use and continued to learn, 
while the medical students directed their study to 
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other area.s of medicine. The important conchisiou, 
however, was that use of media did not interfere with 
the ediicational process. 

Evaluation efforts weie not always so successful. 
Upon acceptance of the telephone circuit as an 
effective teaching medium, one bf the subsequent 
studies attempted to determine if additional independ- 
ent study through assigned "home work'' would 
increase the effectiveness of.the conferences. An eight- 
hour course in hematology \yas designed and registrants 
divided into an experimental group which would 
receive outside reading assign men t.s, extra slides to 
study, and self-assessment tests in addition to the 
conferences, and. a control group which would only 
attend the conferences. This course was measured by 
pre-tcst and immediate post-test. 

The control group showed a 'light, but statistically 
insignificant increase in knowledge. The experimental 
group showed a slight, also statistically insignificant, 
decrease. In eight hours of instruction for one group, 
and a good deal more than that for the other, the 
course Had accomplished nothing. 

Faith in our fac^ult}' and medium led to a more 
detailed examination of the entire stud3\ This analysis 
indicated that course content was at a level of sophis- 
tication appropriate to a specialist in internal medicine 
with a special interest in hematolog}% while the 
participants were general practitioners who did not 
have the knowledge base required to assimilate the 
course content. We succeeded in confusing them, 
rather than teaching them. 

A succession of similar minor .studies invariab^^' 
uncovered human rather than technical sliortcom* ^^s, 
and the conclusion is that the medium is as good or 
bad as the educational programming provided over it. 

At this point in time, it is thought the telephone 
conferences are meeting the. initial goals set for them. 
By offering a limited amountof information frequently, 
the circuit makes it possible to achieve truly continuing 
education. Subjective respon.se from participants in- 
dicates that for the most part the programs arc relevant 
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Fig. 2. Telephone Dial Access Library. Opehitor rceeiving call to'Wiscpnsj Dial Access Library places appropriate iartri(lge in 
the playback unit, presses a button to connect the nnit with the telephone line, and is theii ready for the iicxt call while the tape 
plays to its conclusion. Five callers may be served simultaneously frohi the library 



to clinical practice. The average co.st of S 2.68 per 
individual hour of instruction in 1971-1972 appeai-s 
reasonable. The fact that the programs arc offered for 
physieians in the early morning houn?, and eaeh 
participant can be making his hojjpital rounds within 
a few minutes of the end of a program, means that he 
is not removed from his practice for any substantial 
period of time. The department thinks its calibre of 
programming is high, but there has been no substan- 
tiation of this goal. 

There is dissatisfaetion with the eurrleulum 
development proeess, relating to both relevanee and 
quality of instruction ; selection of subjects is based 
more on intuition and individual judgements than on 
any objective data related to identified needs. Efforts 
to explore this will be diseussed later in this paper. 

Dial Access Library 

In April of 1066 the department began a feasibility 
study of a seeond use of media in continuing education 
[8]. There appeared to be need for an immediate 
source of information which was not being met- by 
traditional reference sources. Either standard refer- 
ences were not immediately available, or the physician 
had reason to believe that the information they 
contained was out-dated. 



To meet this apparent need, a luiinber of short 
(4-6 inin) tape recordings were made on the diagnosis 
and treatment of specific diseases and conditions. 
These w;;rc placed in self- rewinding cartridges that 
could be played on tape repeaters connected to tele- 
phone lines. Fig. 2. In this way, a physician who felt 
unsccure about handling a particular patient problem 
could call the service at any time of the day or night 
and listen to the appropriate tape recording. On the, 
basis of utilization figures during this feasibility study,! 
funds were obtained to expand the service. At present 
the library contains over 500 tape recordings. It is 
available to physicians in Wisconsin on a subscription 
basis and through a contractual arrangement with the 
federal government to all physicians in Veterans 
Administration hospitals and Public Health Service 
clinics and hospitals throughout the United States. 

The service has been evaluated by means of a 
record of all calls received, and a post-card survey of 
users. While the initial intent was to provide a service 
for family physicians, it has proved to be of almost 
equal use to spccialitSts and those in training (Table 2). 
While designed to meet specific patient problems, it is 
being used as a general educational resource with equal 
frequency (Table 3). Perhaps most important, 19.7% 
of the users surveyed (from among those calling with 
specific patient problems) indicated they changed 
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Table 2. Dial access librar}- distribution of calls by type of 
practicc-(22 months) 

Type of caller Percent of total calls 



General practitioners Ji4.5 

Specialists 28.1 

hi training 28.4 

Others '9.0 



Table :i. Dial access library .primary reason' for call (nine 
month's) 

Reason Percent of total calls 

Specific patient problem 44.8 ^ 
General reason 47.6 
Both 7.0 



their management of the patient as a result of informa- 
tion obtained from the tape recording: Another 12.8% 
of the total users surveyed (from among those who 
ealledior general educational -purposes) indicated they 
would change certain aspects of their patient care as a 
result. Thus nearly one-third of the calls resulted in a 
reported change in behavior by the physician. 

The dial access library has been of some assistance 
ill identifying possible common educational needs. By- 
maintaining utilization records for each .specific tape, 
and. tot a I usage for tapes in a general area of medicine, 
it is possible to make judgements in curriculum 
planning. For example, Wisconsin physicians have 
most frequently called for tapes on marriage counsel- 
ling, the Rh-ncgative pregnant patient, cardiac 
arrhythmias, and drug abuse hy teenagers. Veterans 
Administration physicians have most frequently called 
for tapes on drug abuse and alcoholism. 

The concept of the dial access library has been 
adopted by others since its inception. At present there 
are 13 such services in the United States and Canada, 
serving 20 states and provinces. Evaluation to date 
has replicated the Wi.sconsin strategy; consequently 
judgements as to the value of .such services arc based 
on similar .subjective data. There is.no objective 
cvidcnco as yet that use of the dial access library 
results in unproved patient care. 

Single Concept Films 
Early in program development, the department 
also detected an apparent need for a medium which 
would shoNv motion in the teaching process; there are 
a certain number of comparatively simple techniques 
and procedures which have been recently introduced 
and cannot easily be mastered by reading about them 
or observing photographic slides or printed visuals. 
Traditionally in medical education these topics have 
been the subject of 16 mm films of 30-60 min duration. 
While film was considered an effeetive medium, it was 
thought that in deference to the physician's time 



constraints it would be nloic helpful if such films coulH 
be limited to a single concept and restricted to essential 
information in porfonnance of the ^procedure or 
technique. Also, to avoid the problems of acquiring a 
projector and screen, threading the film, and darkening 
the room for viewing, it wasdecided to use an automatic 
projector with self-rewinding 8 mm film cartridges: 

Such an educational program was initiated [13]. 
Five films were produced and a sixth adapted from ii 
locally produced film. These were made available in 
the community hospital and acceptance was enthu- 
siastic. As a result, the program was expanded. 
Adaptation of the one film proved significantl}'' Jess 
expensive, so new content was obtained by reviewing 
-longer films produced by other sources, determining 
if there was a iO-lo min segnicntr' which gave tlie 
essential information and, if so, requesting permi.ssioii 
to exerpt that portion. In this way an additional 
50 films were produced. 

The program proved highly popular. Initially a 
hospital ordered a series of six films and wa.s sent a 
projector and one film a week for six weeks. When the 
backlog of orders resulted in nearly a year's delay it 
was necessary to order more projectors arid reduce the 
time for viewing one series to three weeks. 

Evaluation of this program has been somewhat 
limited. A counter \\as placed in each projector, so a 
record could be maintained on utilization (Table 4). 
This was further refined in level of utilization by size 
of hospital (Table 5). Questionnaires were placed next 
to the projectors; responses were obtained from less 
than 50% of the viewers. The questionnaire indicated 
that 93% of those responding found the information 
contained in the films of value in "their practices. 

Table 4, Single concept films times machine tnrned on 
(40 hospitals) 

Total : 5472 

Total per hospital (av.) ... ... 1:17 

Weekly tot^l per hospital (av.) ... 23 



Tabic 5. Single concept films 



No. of medical 
staff 


Average times machine 
tiimed on/6 weeks 


0-10 


93 


11-30 


139 


31-GO 


121 


(51-150 


189 


151-295 


232 



The program is now operating at a reduced level ; 
all hospitals in Wisconsin ^that have interest in the 
films have had them and high cost has restricted new 
production. The expericnect, however, gives the de- 
partment confidence that it will find the new video 
cassette units of value in its educational program, and 
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anticipates these will be less expensive in development 
of prog rain content. There is also thought of con- 
bcntrating on topics which have repeated use as part 
of a hospital inservice training program, rather than 
those which hospitals accept only for one-time viewing. 
This repeated utilization as a part of a continuing 
inj»*5ryice progl*am would also offer greater potential for 
evaluation in terms of behavior change and improved 
patient care. 

TapcJ Slide Programs 

Production of tape recordings for the telephone 
conference programs, along with 75 sets of accoih- 
pan3^ing visuals, soon began to create a storage 
problem. To relieve this, the department began to 
iiiake the lecture tapes available by sale to hospitals 
aiid individuals for independent study. While the 
motives Hiave little educational merit, the program 
apparently does. -Sales have been substantial, and when 
the units were placed in the medical library for use 
by those in training, utilization levels were high. 
Arrangements are how being made to have selected 
progi;ani units available through a nationall}^ estab- 
lished publishing firm. 

In spite of the faot that the effectiveness of audio 
tape as an educational medium has been accepted since 
its use by the U.S. armed forces in World War II [12], 
a study was carried out with medical students to re- 
cpnfinn this. A series of lectures which were tradi- 
tionally presented with great . frequency to small 
groups of students was selected, tape recordings made, 
and visuals produced. The third-year medical school 
class was divided into three groups; One received its 
information by live lecture, the second by tape/slide 
units in study carrels, and the third by tape/slide units 
i&home study kits. Pre- and immediate post-testing 
were used. There was no significant difference in the 
acquisition of knowledge among the three groups. 
Late post- testing was attempted but loss of both 
contact and control over the students resulted in 
in.sufficient data on which to base conclusions regarding, 
retention of knowledge. 

The department has been notably unsuccessful in 
automating its presentation of tape/slide program 
units, to the point that the current basic equipment 
used is a cassette player and a hand operated slide 
viewer: Experience with synchronized units has been 
di.sappointing, due to lack of dependability and high 
repair levels. With the low cost of the unsophisticated 
equipment, and apparent acceptance at least by stu- 
dents, the department feels comfortable with the 
present system. ''However, experimentation continues 
in the development of an automat<5d .system which will 
give the u.scr a minimum of inconvenience and maxi- 
mum of control over the, program unit. 

Slotv Scan Television 
All of the media used by the department at this 
time require advance production of educational 



content. It appc^ared to the .staff tiiat there would be 
merit in making some of the more than 50 educational 
events^ occurring weekly in the medical center available 
on a broader geographic basis. Presenting Lhe audio 
portion would be simple, utilizing telephone lines. Real 
time transmission of video, however, presented prob- 
lems since there is no statewide educational television 
network available in Wisconsin and the prospects of 
financing such a systoni did not appear realistic. 

Por this reason, the department began an experi- 
ment with .slow scan television,. a method of transmit- 
ting still visuals over regular telephone lines and* 
displaying them on television monitors at remote site.s. 
While the investment in equipment would be e.ssen- 
tiall}^ thesanieas with regular television, the continuing 
c6.sts of technical staff and transmi.s.sion lines would be 
greatl}'^ reduced. 

A prototype system was constructed by a national 
eleetronies firm and installed in four community % 
Hospitals. Diie to technical problems which arose in 
establishing and maintaining the .system, little valid 
educational use or evaluation were possible. While the 
equipment has been modified for an experiment^ in 
satellite communication, the possibility of its use in 
general continuing medical education is not being 
pursued at this time. 

Value ol Media 
It is the concensus of the staff of the Department 
of Postgraduate Medical Education that the use^of 
instructional media has enabled it to present a vauety 
of continuing education to substantial numbers of 
health professionals in Wisconsin. In the process, it 
has carried out limited evaluation which leads to the 
conclusion that the use of media does not detract from 
the teaching- learning process. The evaluation has not 
confirmed that the educational programming presented 
via media has in any way improved the care delivered 
to the patient, which the staff thinks is the ultimate 
measurement of any continuing education program. 
However, for the immediate future, and until the 
techniques are available to measure quality of patient 
care, there appears to be .sufficient .supporting infor- 
mation to warrant continuation of present program- 
ming and innovation in methods and media. 

New Problem Areas 
From an intro.spective point of view, perhaps the 
major contribution of instructional technology is that 
it has forced the department of evaluate. There is 
little demand that traditional educational methods be 
assessed; pcoble assume that the library and lecture- 
discussion method of instruction are effective. How- 
ever, if the content of the library is made available 
through an automated information retrieval .sy.stom, 
or the lecture-discussion events are presented over 
telephone, both the facult}'^ and administration want 
data on the effectiveness of Ihese **new'' methods and 
media. . • 
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This responsibility ^oon developed into an cntlnisi- 
ajjtic, if at times inept, coinniittinent to evaluaf 
As a. ixjsult, the department is now deeply involved in 
some substantive areas of education which have great 
significanee to the effective use of instmctional tech- 
nology. 

The problems raised by experience to date seeih to 
fall into three major categories . 

1 . Identification of educational needs. 

2. Effect of continuing education on quality of eare. 

3. The continuum of education. 

Identification of Needs 

'K&r\y in the development of postgraduate coui-ses 
for physicians, considerable experi mention was carried 
out in curricuhim design. Some of the more traditional 
liiethods did not seem to ronder the desired results. 
The first method used was to consult with leading 
faculty at the medical schoor to determine what tiiey 
tliouglit was importantfor the practitioner to learn. As 
teachers, and reseaiehers, the faculty must remain 
current, through reading and othei' activities, in their 
knowledge of new developments in their specialized 
fields. As consultants, they gain insight into the 
limitations and requirements of primary care physi- 
cians. I'hrough telephone inquiries and informal 
discussions with clinicians, the}^ develop a grasp of 
what problems are bothering those in practice. Conse- 
quently it was thought the faculty would be a valuable 
resource for curiiculum development. 

As programs were presented, and rapport estab- 
lished with practicing physicians, the department began 
to seek their opinions as to what should he taught. The 
obvious thesir is that the practicing physician is well 
qualified to identify those areas in which he needs 
educational assistance. 

Finally, as physicians on the departmental staff 
gained experience in continuing education, they de- 
veloped a degree of confidence in their ability to 
design curricula which would be relevant to clinical 
practice. 

These three sources were utilized almost ex- 
clusivcl}^ in varying sequence, to develop program 
content for the technical systems as they were estab- 
lished. Retrospective studies', based on attendance 
figures and i)articipants* comments, indicated that no 
method was measurably superior; they were equall}^ 
good — or bad. 

The suspicion that it was the latter was strength- 
ened by experience. As a group of practicing pJiysicians 
would sit around a table with departmental j^taff to 
develop ajcurriculum for a specific series of teaching 
prograins, more often than not they would suggest 
varied and cveii conflicting lists of potential topics. 
These were practitioners selected because thc}^ were 
leaders in their communities and professional societies, 
and supposedly could present informed viewpoints 
representative of their peers. Even when these opinion 
leaders could agree on common topics, subsequent 
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feedback to actual piogiamniing brought varied 
comments as to the relevance of the curriculum to the 
practice of medicine. 

This led to. both fmstration, and the thought that 
pcrFiaps there are fewer common eductipnal needs than 
one would expect. Perhaps individual medical practices 
differ to such an extent that cduciitional needs also 
vary greatly from one individual to the next, regardless 
of the specialty label affixed to their common ai-ca of 
medical practice. 

Individual Physician Profile 

To test this thesis, a research project was designed 
to survey a physician's practice, test him on those 
diseases and conditions he treated mos^t frequently, 
.consult with him. on educational needs indicated by 
the process, and then help lum design lin individualized 
continuing education grogram. 

IThc research was conducted under contracts 
NIH 70-4008 and NIH 70-4030 with the jBurcau of 
Health Manpower Education, National Institutes of 
Health, between July 1, 1968 and June 30, 1971. The 
first 18 months were spe.:t in development of proce- 
dures and resources required, and experimentation 
with the cooperation of 37 physicians. The second 
18 months involved changes and improvements of 
procedures and resources from the first study period, 
devclopinent of new resources, and experimentation 
with the cooperation of 76 ph3^sicians. By the end of 
the three years, the department was satisfied that it 
had a reasonable procedure for helping individual 
family practitioners identify their unique educational 
needs. Limited experience suggested it ilid not work 
as well for specialists, probably bccausd the testing 
means has not been sufficiently refined.? 

To collect data on his practice, the physician is 
asked to dictate into a portable tape recorder certain 
information on each patient contact. This includes 
age and sex of patient, method or place of contact 
(office, hospital, telephone, or home visit), significant 
presenting signs or symptoms, major tentative di- 
agnosis, contributing diagnoses, tests ordered, and 
treatment or disposition. These data are collected one 
day a week for four weeks, to obtain a representative 
sample of the phy.|;ician's practice. The tape cassettes 
are transcribed and the diagnoses coded in the Inter, 
national Classification of Diseases, Adapted (ICDA) 
to develop his practice profile. 

A computerized test bank, containing approxi- 
mately 2000 questions, also coded in the ICDA, has 
been developed. The practice profile is entered into the . 
computer and an individualized test composed, based 
on the profile. The intent is that the test reflect the 
volumes and distribution of patient problems according 
to the ICDA listing. The test is given and the results 
fuinished to both the partiqipating ph3^sician and a 
facult}^ consultant. 

On the basis of the practice profile, test results, and 
other information gained in discussion with the 
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physician, the two then jointly arrive at a program of 
continuing education. This program is entered into the 
computer where a listing of educational resources is 
stored, also coded in the ICDA. The coinputer prints 
out a listing of educational events and materials 
matched to the areas selected for'sfudy. From this Hst 
the participating physician selects those conferonees, 
audio-visual materials; etc; which appear to.be most 
appropriate. 

Of the 76 physicians who participated in the second 
study phaso, C3 were family practitioners, seven 
pediatricians, five internists, and one a surgeon* The 
conclusion at the end of the stiuTy was that the proce- 
dure did help the family practitioners identify their 
unique educational needs. The procedure is now being 
-tiiia^de available to .all family practitioners in Wisconsin 
under a pi'ograni sponsored by the W. K. Kellogg 
rounda*J<;n, Battle Greek, Michigan, in cooperation 
with the Wisconsin Academy of Family Physicians: It 
is hoped that 400 family physicians \^ill be enrolled in 
the prograin by 1975. ReJscarch is continuing on 
improving the procedure and resources to the point 
that they are equally successful for medical specialists. 

Technology played an important role in the re- 
search. In most cases it was a successful application; 
in some it was not. The use of the computer in storing, 
analyzing and retrieving physician and patient data 
was invaluable. The storage und retrieval of individual 
test questions and appropriate educational resources 
v;as also critical to the program. One feature which 
was unsuccessful was an attempt during the first 
study phase to conduct an on-line, interactive test. A 
portable telet3^pe was delivered to the physician's 
office and, by means of telephone line,. access was, 
gained to the computer, often more than 100 miles 
away. The physician's profile would be entered and 
within seconds the test would have been composed and 
the first question printed out on the teletype in the 
physician's office. He would read the question, select 
an option, and give his i-csponsc. The computer u ould 
indicate whether it was right or ui-ong, and if wrong 
would immediately give him the correct answer. It 
would then print the .second question. Due to signif- 
icant technical problems, high cost, and the distracting 
noise of the portable teletype, this method was 
abandoned in the .second study phase and a wriften 
test sub.stituted. 

Broader Implimiions 
The department is encouraged b}' the results 
related to identifying and meeting individual educa* 
tional needs; it is also enthusia.stie about the possibili- 
ties for use of cumulative data obtained in the project. 
For the first time there are reasonable data available 
concerning family practice in Wisconsin, which can 
be used both in continuing education and to make 
decisions earlier in the continuum of medical education. 
The data collected, when sufficiently substantial to 
warrant it, will be compared with the medical school 



curriculum and it is anticipated that judgements will 
be possible on whether or not the eurrent educational 
program prepares the physician to meet the patient 
problems he will encounter in practice. 

Peer Review 

Another j)romising technique of (ictccting eduea» 
tional needs involves a peer review process, ba.scd on 
hospitalized patients, developed by Clement Brown, 
M. D., at Chestnut Hill Hcspital, Philadelphia, Penn- 
sylvania 13]; Robert L.Evans, ])., at York 
Hospital^ York, Pennsylvania ; -and Beverly ]\vne, 
M.D., for the Michigan State Me(iicahSoeidyJajKl 
Hawaii Medical Association. 

The procedures u.scd require a ho.spital .staff to set 
criteria for optiinuin trcjitinent of .specific di.sea.ses and 
conditions, examine patient records to determine how 
well these criteria are met in practice, and take 
corrective action to close the gap between actual and 
optimum care. The needs identified, at times, require 
an educationa! solution; at times they call for other 
action. Efforts are now being made i)y researchers in 
the United States to apply these procedures to 
ambulatory care. 

Self -Assessment Tests 
A number of national medical organizations in 
the United States have also provided their ineinbors 
an op|)ortunity to assess their medical knowledge by 
administering, voluntary nationwide self-as.se.ssment 
tests [4, llj. Members who participate receive ex- 
tonsive testing throughout their areas of .specializa- 
tion, often adinini.stercd over a scries of weekends. The 
results arc either furnished immediately or after 
centralized .scoring, so that each may detect his ai^as 
of weakness. 

Team Surveys 
Another approach to identifying educational as 
well as other needs has evolved at the University of 
Wiseonsin, with the Department of Po.stgraduate 
Medical Education playing only a minor role in the 
initial organization. This involve.^ a perinatal care team 
consisting of a pediatrician, a nur.se, and an engineer 
visiting a hospital. The two health professionals 
examine the procedures involved in the cave for 
newborns and the engineer examines the equipment 
used, to determine that appropnate * equipment is 
available and that it is functioning pmperly. After 
the visit, during whieh much teaching is done, the team 
provides a written report with its recommendations 
for improving care of^the newborn. 

Quality of Care Assessinciit 
Another major pmblein encountered involves 
evaluation of the end result of continuing education, 
its effect on the quality of care. As previously indi- 
cated. Brown [S] has shown that for the 20% of 
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iiu:(Iicdl practice tliat is hospital based, there is 
measurable improvement when deficieneies are doeu* 
meiited and educational programs are instituted 
wherever they nmy be appropriate. For the approxi- 
niatel}* 80% of practice that is outside tlie hospital, 
virtually no similar investigation has been carried out. 
The individual physician profile process does not deal 
with (|Uality of care, except by inference. 

Until such mechanisms arc developed and vali* 
dat^d, it will be difficult to evaluate continuing educa* 
tion, whether instructional technology is involved or 
not. in verms of the end result. 

Comimiiim ot Educaiion 

In exploring some of its shortcomings in continuing 
education, the department found itself considering the 
total educational process to which health professionals 
are exposed, and viewing it in the context oLrccent 
educational philosophy. This led to the questioning of 
some basic dogmas upon which medical education in 
the United States is built. 

The .student, through his minimum of eight years 
in higher education, is required to make significant 
adjustments in his Icarm'ng patterns. As an under* 
graduate, he is directed through a .structured cour.sc 
of study centered on certain prerequisites he nmst 
complete for entry into medical school. During his 
first two years of medical education he encounters a 
similar structure for ihastery of the basic sciences, 
ba.sed on reading, lectures, and laboratory experiences. 
For the next two years he acquires clinical knowledge 
and skills by .substituting a tutorial relationship with 
the faculty for his laborator}^ e.xerciscs, and continues 
with hi.s reading and lectures. Upon receipt of the 
niedical.dcgrcc, and entry into internship and residency 
training, the tutorial relationship becomes dominant 
and the importance of lectures decreases, while reading 
continues as a primar}^ .study nicthod. He has access 
to a multitude of conferences, many dealing with 
ah.strusc but interesting cases, and may well fail to 
acquire a realistic view of the everyday practice of 
medicine. 

Final 1}% upon entr}^ into private practice, the new 
physician not onl}' has to face the challenges this 
presents, but also finds himself separated from the 
educational .system upon which he has relied for .so 
man}' years. No longer is someone else respon.sible for 
dcterniining his educational needs and developing the 
necessary curriculum. He is also separated from the 
educational methods on which he has most recently 
relied. 

If this rationale is valid, it is small wonder that the 
practicing physician leans heavily on the learning 
methods which are most readily available, reading and 
di.scussion with colleagues. Many supplement these 
with other familiar methodologies .such as lectures, 
when they are available. With this background, it is 
logical that the introduction of technology into the 
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continuing education .field is a slow and often dis* 
appointing process. 

Equally, in his formative years in training for 
medicine, the student is given little opportunity to 
define his own personal objectives and, perhaps niori* 
important, to learn the manner in which he can most 
comfortably and efficiently acquire the concepts and 
skills neces.sary for_^tlie practice of quality medicine 
throughout his professional lifctiiiie. He has little 
opportunity to assess his own progress, yet eventually 
he will have to take full respon.^^ibility for this through 
the subsequent forty years of his learning life. 

The assumption is therefore made that if the nicHli* 
cal .school and graduate experiences can be .structured . 
so that the .student takes an increasing role in his own 
objective setting, learning methodology, and progress 
assessment throughout his training |)criod, he will bo 
better able to nmnage the transition into delivery of 
optimal care, using his own unique learning styles and 
capabilities to maintain and inerca.sc his com|)cteiiec^ 
throughput his professional lifetime. 

On the basis of these assumptions, tlio.se responsible 
for continuing education at the University of Wisconsin 
now find themselves involved ir the medical school 
teaching program. The intent is not that the .structured 
portion of medical education must be changed to 
accommodate continuing education, but that the 
entire continuum cf medical education will be improved 
by the changes suggested. 

Summary and Conclusions 
The department ha.s confidence that in.struetional 
technology is nmking a valuable contribution to 
continuing education of health professionals in Wiscon* 
sin. It is sati.sfied that educational services arc being 
provided for substantial numbers of health care 
personal that would not be possible without the 
emphasis on media. There is also soine^ objective 
evidence, outside of the obviou.s virtues, that the 
variety and volume of progranuning eventuall}' bene* 
fits the patients. 

However, there is a growing conviction that the 
full potential of the instructional teelmqlogy is not 
being realized. Before this can be aeeompli.shed there 
must be rational methods of needs assessment and 
{lerhap.s some ba.sic changes in the continuum of 
medical education. 

Finall}', if the ultimate goal of continuing education • 
is optinmm quality of health care for the patient, 
some nieans must be developed to assess this quality 
.so that the faculty, program planners and practicing 
phy.sieians have objective data available to them as 
the basis for making educational deei.sions. 
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